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ARTIFICIAL VISION METHOD AND SYSTEM 

TECHNICAL FIELD 

The present invention relates to an artificial vision method and system. The 
invention may, for example, be used for control in robotics systems. 

BACKGROUND 

Traditionally artificial vision systems have been either discrete or continu- 
ous. 

Discrete systems are characterized by a large number of logical states (0 or 
1), normally implemented by a computer, which gives a rich structure. This 
allows for switching of the system between many different states imple- 
menting different models. However, a continuous transition between models 
is often difficult with such a structure, since the discrete switching structure 
can not easily transfer knowledge about system states and boundary 
conditions. 

A continuous system implements classical control strategies- This generally 
allows only a fairly limited complexity, with a limited number of variables, 
since the systems otherwise become veiy unwieldy, 

SUMMARY 

An object of the present invention is an artificial vision method and system 
that has a rich structure and allows continuous transitions between differ- 
ent models. 



This object is solved in accordance with the appended claims. 
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BRIEF DESCRIPTION OF THE DRAWINGS Huvudfaxen Kassan 

The invention, together with further objects and advantages thereof, may best 
be vinderstood by making reference to the following description taken together 
*5 with the accompanying drawings, in which: 

Fig, 1 is a set of diagrams illustrating generation of an image percept 
vector of a one-dimensional image containing a dot; 

Fig. 2 is a set of diagrams illustrating generation of an image percept 
vector of a one-dimensional image containing another dot; 
10 Fig. 3 is a set of diagrams illustrating generation of an image percept 

vector of a one- dimensional image containing still another dot; 

Fig. 4 is a set of diagrams illustrating generation of an image percept 
vector of a one-drmensional image containing two dots; 

Fig, 5 is a set of diagrams illustrating generation of an image percept 
15 vector of a one-dimensional image containing two different dots; 

Fig. 6 is a set of diagrams illustrating generation of an irnage percept 
vector of a one-dimensional image containing two closely spaced dots; 

Fig. 7 is a two-dimensional image containing two dots; 

Fig. 8 is a diagram illustrating a detector arrangement for generation of 
20 an image percept vector from the image in fig 7; 

Fig. 9 is a diagram illustrating the image percept vector generated by the 
detector arrangement in fig. 8; 

Fig. 10 is a diagram of a circle that is shifted along a horizontal line for 
training purposes; 

2 5 Fig. 1 1 is a diagram of a circle that is shifted along a vertical line for 

training purposes; 

Fig. 12 is a diagram of a set of different size circles used for training; 
Fig. 13 is a diagram illustrating a detector arrangement for detecting 
line segments; 

?0 Fig. 14 is an embodiment of an artificial vision system in accordance 

with the present invention; and 

Fig. 15 is a flow chart illustrating an embodiment of the method in 
accordance with the present invention. 
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DETAILED DESCRIPTION Huvudlbxsn Kosson 

An essential feature of the present invention is an image percept vector. This 
concept will now be described with reference to fig. 1-9. First the concept win 
be described in one dimension (fig. 1-6). Then the concept wiU be generalized 
to two or more dimensions (fig. 7-9). 

Fig- 1 is a set of diagrams illustrating generation of an image percept vector of 
a one-dimensional image containing a dot. The upper part of fig, 1 includes an 
image along a line segment from x=0 to x=10 with a single dot at x-7. Thus 
this image could simply be represented as "x*?", the location of the dot. 

Another way of representing the image, called channel representation, is 
suggested by the manner in which the dot may actually be detected. To detect 
the dot some kind of detector is used. In order to give any information on the 
location of the dot, such a detector can not cover the entire image. If this were 
the case, the detector would only indicate that there is a dot in the image, but 
not wher« it is located. Thus, it is natural to use an array of detectors, each 
covering only a part of the one-dimensional image. Such an array is illustrated 
by the curves in fig. 1. Each curve represents the transfer function of a local 
dot detector. In fig. 1 a typical dot detector has the transfer function: 



cos 



3 3 

if k <x<k + - 

^2 2 

otherwise 



With this choice the detectors will have their most sensitive center portions at 
integer coordinate values x=k. This is of course not necessary. With other 
choices of scaling factors and ofi"sets in the argument of the raised cosine 
function, the density and overlap of these detectors may be varied. Further- 
more, other choices of transfer functions, such as gaussian transfer functions 
are also possible. 
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An essential and required feature of a detector arrangement is that the 
application of a stimulus activates more than one channel. For a description of 
point objects, this requires that the transfer functions of the detectors partial^ 
overlap. This implies that the single dot at x=7 in fig, 1 will activate several 
.5 detectors. In fig, 1 the activated detectors have been indicated by thicker solid 

curves. Only the detectors that have non-zero transfer functions at the 
location of the dot will be activated and produce a non-zero output signal. This 
has been indicated by the bar diagram under the array of transfer functions in 
fig. 1. For a dot at x=7, the detectors at x=6, 7, 8 will be the only activated 
10 detectors. The detector at x=7 will give an output signal p7=l, while the other 

^ two detectors will give p6=Pe^0.25. As indicated at the bottom of fig. 1, the 

image (the dot) may be represented as the image percept vector: 



15 



x = [0 000000 0.25 1.0 0.25 O 0 Of 



where *^ denotes transpose. Typically most of the outputs or vector elements 
will be zero, i, e. the vector is sparse. While the output of a single channel 
(detector) would not \iniquely define a corresponding scalar value x, the set of 
outputs fi'om partially overlapping channels will (a method for converting a 
2 0 vector to a scalar will be described below). The reason for the extra two 

detectors (at x=-l and x=ll) at the ends of the image is the required overlap of 
the transfer functions. 

Fig. 2 is a set of diagrams illustrating generation of an image percept vector of 
25 a one-dimensional image containing another dot. This figure illustrates that 

the number of activated detectors will depend on the location of the dot. In 
this case the dot is located at x=6-5- Therefore only the detectors at x=6 and 
x=7 will be activated. However, at least two detectors will always be activated 
(due to the overlap) irrespective of the location of the dot in the image. 



Fig. 3 is a set of diagrams illustrattng generation of an image percept vector of 
a one-dimensional image containing still another dot. This figure illustrates 
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that the dot may have an arbitrary location (x=6.73 in the example) in the 
image and still be detected and represented by an image percept vector X. 

Fig. 4 is a set of diagrams illustrating generation of an image percept vector of 
a one-dimensional image containing two dots. In this case the image percept 
vector X will include two detector sections with non-zero outputs correspond- 
ing to the two dots. Note that the number of dimensions of the percept vector 
is still the same as in fig, 1-3, although the image now contains two dots. 

Fig. 5 is a set of diagrams illustrating generation of an image percept vector of 
a one-dimensional image containing two different dots. In this case the dots 
are closer to each other, but they can stiU be identified as two separate dots. 

Fig. 6 is a set of diagrams illustrating generation of an image percept vector of 
a one-dimensional image containing two closely spaced dots. In this case the 
detector at x=6 is activated by both dots, and it starts to become difficult to 
separate the dots. This illustrates the fact that the detector density must be 
determined by the desired resolution on the image- 
Having described the concepts of channel representation and image percept 
vectors for the one-dimensional case, it is now time to generalize these 
concepts to more realistic two-dimensional images. 

Fig. 7 is a two-dimensional image containing two dots. One is located at x=l, 
y=9 and the other at x=6.25, y=2.75. As will be illustrated below, this two- 
dimensional image may also be represented by an image percept vector. 



Fig. 8 is a diagram illustrating a detector arrangement for generation of an 
image percept vector from the image in fig 7. In this case there are two- 
dimensional detectors having typical transfer functions: 
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where Ic and Z are the integer center points of the detectors. In fig. 8 the 
coverage area of each detector in the two-dimensional arrangement has been 
indicated by a circle. As in the one-dimensional case, a dot will activate only 
nearby detectors. The detectors activated by the dots at (1, 9) and (6,25, 2.75) 
have been indicated by thick solid circles. 



Fig. 9 is a bar diagram illustrating the image percept vector generated by the 
detector arrangement in fig. 8. In fig. 9 the bars are distributed in a two- 
dimensional array similar to the coordinate grid in fig, 8. However, this array 
may be rearranged into a column vector, as in the one-dimensional case, by 

starting with column 1 in the array, concatenating column 2 to the end of 

» 

column 1, concatenating column 3 to the end of column 2, etc. Another way of 
15 rearranging the array into a vector is to concatenate the rows of the array 

instead and then transpose the obtained row vector into a column vector. In 
fact, how the array is rearranged into a vector is irrelevant, for the purposes of 
the present invention, as long as all detector outputs are included in the 
resulting image percept vector x and they maintain the same position 
20 throughout all steps. The image percept vector components may simply be 

viewed as a collection of unordered channels (channel representation). In a 
typical system the image percept vector x has between 10^ to 10"* components. 



The concept of percept vector may also be generalized to three-dimensional or 
25 four-dimensional (the fourth dimension representing time) images. The 

percept vector of such an image may still be formed by forming a column 
vector from the detector output signals. 

The above described image percept vector x forms the basis for a feature 
30 vector a, which is to be associated with a response state of the system. The 

feature vector a may include one or more of three different functions of the 
image percept vector, namely: 
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1. Linear components, which are formed by the image percept vector 



X = 



10 



itself or selected components thereof 

Autocovariance products, which are formed by diagonal elements of the 
covariance product matrix 



T 

XX = 



X^Xi X1X2 



■■ X2XJ 



and are denoted xx^auto. 



15 



Covariance products, which are formed by off-diagonal elements of the 
covariance product matrix 3K^, and are denoted xx^cov. Experiments in- 
dicate that the covariance products are the most descriptive feature 
vector components, since they describe coincidences between events, 
but the other components should be kept in mind for various special 
purposes, such as improved redimdancy, low feature density, etc. 



20 



Thus, a feature vector may have the form: 



as: 



^ X ^ 

T 

auto 
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In certain cases it may be desirable to employ a logarithmic representation of 
the feature vector a. Furthermore, if increased complexity is acceptable, it is 
also possible to include miolti-covariant products (products of three or more 
percept vector components) in the feature vector. 

In accordance with the present invention the feature vector a is used to 
generate a response vector u in accordance with the equation: 



10 



15 



u = 



^^n ^12 ^iff^ 

• • • ■ 



«2 



= Ca 



where C is denoted a linkage matrix, which will be described in farther detail 
below. The response vector u may typicalty represent a chairacteristic of an 
object of interest, for example the horizontal or the vertical location of the 
center of a circle in an image, the diameter of a circle, the length of a straight 
line segment, the orientation of a Kne segment, etc. Note that the dimension- 
ality H of the feature vector a may be (and typically is) different from the 
dimensionality -K" of the response vector u. Thus, in general the linkage matrix 
C is non-square. 



20 



25 



20 



The purpose of the linkage matrix C is to transform the generally continuous 
but spread out feature vector a into a likewise continuous but concentrated 
response vector u. To illustrate this statement, consider a circle of a certain 
diameter. This circle will result in a certain percept vector x and a corre- 
sponding feature vector a. The feature vector a wiU typically have bursts of 
non-zero elements separated by regions of zero elements. The linkage matrix C 
acts as a "concentrator" that transforms the feature vector a into a response 
vector u having a single bxirst of non-zero elements. If the diameter of the 
circle is changed sUghtiy, the corresponding feature vector a will be different, 
since the bursts will be redistributed, while the response vector u will only 
shift its single burst slightly. What is essential here is the local continuity 
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between variation of the output of a particular active channel and the varia- 
tion of the property and/ or the position of the object having the property 
sensed by the channel. Continuous change of a response variable locally will 
correspond to local, continuous changes within a group of feature channels. A 

-5 particular combination of active feature channels and their values will corre- 

spond to a particular, unique response state (response vector). The major 
characteristic of this system is that it is locally continuous at the same time as 
it allows global discontinuity. The system is contiauous and linear in its local 
mapping of the feature vector over the linkage matrix. On the other hand, it is 

10 highly non-linear and discontinuous in its global mapping, in the sense that 

features come and go, and there is no requirement that feature channels are 
adjacent in some space. As noted above, there is no requirement that the 
channels are located next to each other in the percept vector, as "they will find 
each other^ with a properly optimized linkage matrix (this procedure is 

15 described below). Thus, the illustrations presented in this specification, with 

active channels next to each other, is only for visualization purposes, to make 
the description more comprehensible. In fact, the chaimels may be arranged 
at random, as long as the arrangement is fixed over the entire process and 
every channel reacts continuously to stimuli. 

20 

Once the response vector has been obtained in channel representation form, it 
may be desirable, especially for technical systems, to obtain a scalar value 
representing the response. This scalar value may, for example, be used to 
specify the location of an object, to drive a motor or to visualize system states 
25 on a screen. 

The output from a single channel Uk of a response vector u, will not provide an 
Tinambiguous representation of the corresponding scalar signal u, as there 
will be an ambiguity in terms of the position of u vrith respect to the center of 
30 the activated channel. This ambiguity may, however, be resolved by the 

combination of adjacent channel responses within the response vector u^{uk}. 
By using a STofficiently dense representation in terms of channels, it is possible 
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to employ the knowledge of a particuilar distance between different channel 
contributions (detectors). An example of a sviitable algorithm will now be given. 

If the distance in phase between adjacent raised cosine detectors is n/3 or 
'5 less, an approximate reconstruction of u from the response vector u is possi- 

ble. As noted above, the response vector u will have a burst with only a few 
non-zero values. A first approximation of u may be obtained by the average: 



10 



15 



K 



K 

*=1 



This average is a coarse measure of the location of the burst. A refined 
estimate u of u may be obtained in accordance with: 



{: 



\u=J+S 
[l = fIoor{T) 

where floor is a function that sets its argument to the nearest integer that is 
less than or equal to the argument, and 5 is a correction defined by: 



J = 2 • atan2{x^ y)/ n 



20 



where atan2 is the four-quadrant inverse tangent function defined in the 
interval [-n, n] (as defined in MATLAB*®^ for example), and x, y are defined by: 



y^Uj^y-Uj^y M =0 ifj<l 



?5 



From the above description it is clear that it is the relation between two or 
more channels that allows a continuous mapping between a channel repre- 
sentation and a conventional scalar representation. 
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The linkage matrix C is determined by a training procedure, which will now be 
described with reference to fig. 10. 

.5 Fig. 10 is a diagram of a circle that is shifted along a horizontal line. Each 

position of the circle results in a different pair of feature vector aV and 
response vector u^. However, each pair should be linked by the same linkage 
matrix C. This leads to the following set of equations: 





u= 


• 


»| • 


- un 

• m 
■ ■ 




C21 


C12 • 
C22 ' 


m t 


(4 
4 

• 


4 • 


^2 

• • 


= CA 
















^K2 ' 






4 ■ 







15 



20 



where N denotes the number of shift positions or the length of the training 
sequence and A is denoted a feature matrix. These equations may be solved 
by conventional approximate methods (typically methods that minimize 
mean squared errors) to determine the linkage matrix C (see [1]). With 
respect to this minimization the contimoity in each channel is crucisil, 
because this is what makes it possible to perfomi an optimization. Once the 
linkage matrix C has been determined, an arbitrary circle position along the 
horizontal line may be detected from its feature vector a to produce the 
corresponding response vector u, 



Fig, 11 is a diagram of a circle that is shifted along a vertical line. These 
shifted circles may in a similar way be used to find a linkage matrix C linking 
a feature vector a to a response vector v representing vertical position along a 
25 vertical line. Note that the linkage matrix corresponding to vertical position 

is in general different from the previous linkage matrix C (or rather since it 
is associated with u) corresponding to horizontal position. 

The previous paragraphs demonstrated how linkage matrices could be 
30 determined for finding circle positions along either a horizontal or a vertical 
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line. However, usually it would be desirable to find the position of an object in 
a xy-plane. In a first approximation this can be accomplished by treating the 
horizontal and vertical directions as independent of each other, and by 
assuming that the linkage matrix for one coordinate direction is independent 
5 of the other coordinate. Thus, the linkage matrix obtained from fig. 10 is 

assumed to be determined from training on horizontal lines at many y- 
positions over the entire image and consequently valid for each horizontal line, 
while the linkage matrix obtained from fig, 11 is assumed to be similarly 
determined from training on vertical lines at many x-positions over the entire 
10 image and consequently valid for each vertical line. In practice, training data 

for estimation of both matrices will be obtained during the same session, 
where x and y are in some regular or arbitrary pattern made to assume values 
within the area of definition. With these assumptions the position of a circle in 
the xy-plane may be expressed (in channel representation) as: 

15 




This algorithm works remarkably well in spite of its simplicity. The reason for 
this is that different sets of features generally are active in different regions or 
2 0 intervals of u and v. 

A more accxirate algorithm is gjven by the following coupled equations: 



u = C"v«>a = C"a'' 



25 



where ® denotes the Kronecker product. For example: 
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a" = V ® a = 



v,a 
V2a 



10 



^2^H 



where L is the dimensionaKty of v. It is noted that in these coupled equations 
the coupled feature vectors and a'^ are of higher dimensionality than the 
uncoupled feature vector a. This also leads to correspondingly larger linkage 
matrices and C^, These coupled equations may be solved by conventional 
iterative methods. For example, they may be expressed as: 



v(z-l)®a 
u(z-l)®a 



where index i is an iteration index. Tljus iterated sequence typically converges 
in a few iteration steps. 




15 



The training procedure is similar to the imcoupled case, except that coupled 
feature matrices A'^ and defined by: 
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2 2 

Mfa 

2 2 



2 2 



are used instead of the vmcoupled feature matrix A. Here the superscripts 
refer to the respective training samples. It is noted that u and v may have 
different dimensionalities K and L, respectively. 



10 



15 



From the description above it is clear that the coupled model is more complex 
than the uncoupled model. However, it is also more accurate, since the added 
complexily gives a richer model with larger linkage matrices. 

For a circle another feature, namely the size of the circle may be of interest. 
This feature may be extracted from the same feature vector a as the location 
by using another linkage matrix C^, Thus, if the size (the radius or diameter) 
of the circle is represented by the response vector w, one obtains: 

w = C^a 



20 



Fig, 12 is a diagram of a set of different size circles that may be used for 
training purposes if the simple uncoupled model is used. This model will give 
satisfactory results as long as the center of the circle to be detected is near the 
training position- Combined with the previously described uncoupled model 
for the circle position, it is now possible to completely describe a circle having 
arbitraiy position and size by the set of equations: 



25 



u = C"a 
v = C^a 
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This requires that the C matrices are trained over the entire combined defini- 
tion range of the scalars v and w that correspond to response vectors u, v 
and w. 



A more accurate model is a coupled model that considers variations in both 
circle position and size. This model is described by the equations: 



<8>a = CV 



10 In these equations the vectors within parenthesis are obtained by concate- 

nating the indicated vectors. Thus, a coupled feature vector such as may 
explicitly be written: 



^ Vla^ 




iv^a 



15 

where L and M denote the dimensionality of v and w, respectively. This also 
implies that the C matrices are larger than in the uncoupled case. As previ- 
ously these coupled equations may be solved by iterative methods. 



20 The coupled feature matrices used for training are obtained in a similar way. 

For example, the coupled feature matrix A" may be expressed as: 
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10 



15 



The coupled model may be generalized to any number of response vectors 
required to describe an object. The general rule for forming coupled feature 
vectors is to concatenate all response vectors except the one for which a 
coupled feature vector is sought. The sought feature vector is then formed by 
the outer or Kronecker product between the concatenated vector and the 
uncoupled feature vector. 

A variation of this coupled model (in the multi-dimensional case) is to refrain 
from concatenation of vectors and instead apply the Kronecker product 
operator several times. Thus, in the three-dimensional case one obtains: 



u = C"w®v®a = C"a" 
w = C^v®u®a = C^a^ 



A coupled feature vector such as may explicidy be written as: 
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• 

The coupled model described above couples vectors on the input side. How- 
ever, it is also possible to employ a coupled model that uses coupled response 
vectors instead. For two response vectors u and v this model may be ex 
pressed by the equation: 

u®v = C'^a 
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where u ® v denotes the Kronecker product of u and v: 
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and a is the corresponding feature vector. The linkage matrix C^^ is estimated 
by a training procedure as in the previously described models. This training 
procedure results in the set of equations: 

((u®vy (u®vf ... (u®v)^)=C"^A 



where N denotes the nixmber of samples in the training set. This response 
vector coupled model gives more localized responses, as compared to the other 
models, which is an advantage if the feature vectors for a particular problem 
are not well localized. 



Once the linkage matrix C^^ has been determined from the training procedure, 
it is possible to uncouple the coupled response vector u®v to obtain esti- 
mates of the individual vectors u and v. Such estimates may be obtained from 
the following set of equations: 
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K 



jfc=i 



where d is a scale factor due to the summation of components scaled by the 
sum of the other response vector. In the case discussed above, with raised 
cosine transfer fimctions and a channel separation of rx/3, the sum of a fully 
activated channel vector is always 1.5, and the scale factor then becomes 
d= 1/1.5- Furthermore, in these equations only the products uicvi and not the 
individual factors uk and vi are assumed to be known. 



10 



In three dimensions this model may be generalized to: 



15 



20 



After training and determination of the linkage matrices, estimates of the 
uncoupled response vectors u, v and w may be obtained from the coupled 
response vectors. However, since each coupled response vector determines two 
imcoupled response vector estimates, there will now be two estimates for each 
uncoupled response vector u, v and w. These two estimates may be compared 
to each other, in order to provide a more redundant and reliable estimate of 
the response vector. 



25 



Another embodiment of this model reduces this redundancy by coupling only 
exclusive pairs of response vectors. In such a model response vectors u, v, w 
and t are coupled in accordance with: 
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The solution of these equations gives single estimates of each response vector- 
Such a single non-redundant estimate is deemed sufQcient for most cases. In 
the case of further response vectors, additional coupled pairs may be intro- 
- 5 duced as reqxiired. 



10 



The above described model with coupled output vectors may also be repre- 
sented in outer product notation instead of Kronecker product notation* In 
this notation the model becomes: 



T 

UV = 



W1V2 



where D™ denotes a three-dimensional matrix having the same elements as 
C"^, but arranged in a three-dimensional array instead of a two-dimensional 
15 array. It is also noted that uv^ contains exactly the same elements as u®v, 

but that the elements are arranged as a two-dimensional array (matrix) 
instead of a one-dimensional array (vector). Thus, the two notations are 
mathematically equivalent. The matrix D^^ is obtained by a training procedure 
that results in the set of equations: 



20 



Here UV represents a three-dimensional matrix rather than the product of two 
matrices U and V, 



25 Still another coupled model may be obtained by coupling response vectors to 

linkage matrices. This model may be seen as a variation of the just discussed 
model. This variation consists of projecting the matrix uv on the vector v, such 
that: 
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which gives u except for a scale factor | v) 2, which may be normalized- 

If the same projection is performed on the right hand side (D^^a), one may 
define (in component notation) the projected matrix C": 



7=1 



10 



where isjy, are scale factors. After performing such projections this model may 
be expressed as (in two dimensions): 



u = C«a 
v = C"a 



15 



Since the three-dimensional linkage matrix (on which and are based) 
is the same as in the previously discussed model, the same training procedure 
may be used. 



20 



Generalization to more than 2 response vectors is similar to previously 
discussed models. For example, with three response vectors one obtains: 



ii = C''a 
v = C^a 
w = C^a 



25 



Here the coupled linkage matrices are defined by: 
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k = l...K 
1 = 1,. .L 
m = l...M 



where the coupling vectors a, P, y are defined as: 







P = 






a = 














I"; 


1 



and 

define the three (three-dimensional) linkage matrices. 
A linkage matrix typically has the following properties: 

1. The elements of the linkage matrix are preferably non-negative, as this 
gives a more sparse matrix and a more stable system. Negative values 
are, however, allowed in principle. 

2. The elements of the linkage matrix are preferably limited in magnitude, 
as this as well gives a more stable system, 

3. The linkage matrix is sparse (has few non-zero elements). This implies 
that the system may be handled by procedures that are optimized for 
solving sparse systems of equations (see [2]) for values between two lim- 
its (see [3]), for example O and 1. 
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4. An even sparser linkage matrix providing more efficient computation, 

essentialty without affecting performance, may be obtained by discard- 
ing matrix elements below a predefined threshold (for example 0.01 if 
the elements are allowed to vaiy between 0 and 1). The same method 
• 5 may also be applied to feature matrix A. 

In the description above the present invention has been described with 
reference to a specific type of object, namely a circle. However the same 
principles may be applied to other types of objects as well. For example, fig. 13 
10 is a diagram illustrating a detector arrangement for detecting line segments 

^ ([4] describes line detection in general) . An essential aspect of a line segment is 

. its orientation. The detectors in 13 will detect both position and orienta- 
tion. Such a detector may have a composite transfer function described by: 



15 



2 2 

3 3 

2 ^ 2 
m = 0,1,2,3 , 



(f>-\-m 



7C 



2 



^ Thus, there are foxir detector types (corresponding to m=0, 1,2,3), each detector 

type having a specific preferred orientation. In order to detect an arbitrary 
orientation of a line segment, these four detector types have to be distributed 

20 over the detection region, for example as in fig- 13. The distribution may be 

systematic, as in fig 13, or random. Typically these detectors are less densely 
arranged than the previously discussed position detectors, due to the fact that 
the expected object, a line, wiU activate several detectors. As previously the 
outputs from the detectors are arranged in a percept vector, firom v^hich a 

25 feature vector is formed. A trained linkage matrix is used to obtain a response 

vector representing the fine orientation in channel representation form. If 
desired this response vector may be converted into a scalar orientation value. 
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Other characteristics for a line segment are its position and length. These 
properties may be detected from the same feature vector as the orientation by 
using different trained linkage matrices • As previously it is possible to use 
both a coupled and an uncoupled model. Training of the linkage matrices is 
• 5 performed by using different line segments having different known positions, 

lengths and orientations. 

Other objects, such as triangles, squares, arcs, ellipses etc may be detected in 
similar ways. 

10 

Another essential feature of the method in accordance with the present 
invention is that a response vector may be used as a percept vector for 
detection of higher level characteristics. Thus, it is possible to detect a com- 
posite object by combining response vectors from its parts into a new percept 
15 vector, form a new feature vector representing the composite object and form 

new response vectors representing the composite object with new trained 
linkage matrices. 

Pig- 14 is an embodiment of an artificial vision system in accordance with the 
20 present invention. An external world scene 10, real or simulated, is recorded 

by a geometric mapper 12, such as a camera, a video camera or any other 
means that produces one or several iroages to be analyzed. A receptor to 
channel mapper 14 including an array of detectors produces a percept vector 
for each image. A computational structure 16, typically including a microproc- 
25 essor or a micro/ signal processor combination, transforms each percept 

vector into a corresponding feature vector and generates response vectors 
describing an object by using corresponding trained linkage matrices. Com- 
putational structure 16 is also connected to a training sequencer 18, During a 
training phase this training sequencer generates changes, either systematic or 
30 pseudo random, in the external world. For example, the position and/or size 

of an object that the system is intended to track is changed (the size of the 
object in a two-dimensional image may, for example, represent the distance to 
the object). Training sequencer 18 provides each position with coordinate 
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valv.es and each size with a size value. These coordinate and size values are 
transformed to channel representation in a response to channel mapper 20. 
SimUaxly, the obtained sequence of response vectors is recorded in computa- 
tional structure 16 and associated with corresponding detected feature 
5 vectors. When the training sequence is complete, a control signal from trainmg 

sequencer 18 informs computational structure 16 that the training sequence 
has been completed. Computational structure 16 then finds the linkage 
matrices to be used in the future for detecting the same type of object. 



10 



Fig. 15 is a flow chart illustrating an embodiment of the method in accordance 
wilii the present invention. After training the linkage matrices in step Si, step 
S2 gets an image to aaalyze. Step S3 generates the percept vector from the 
image. Step S4 transforms this percept vector into a set of coupled feature 
vectors. Step S5 generates a corresponding set of response vectors. Step S6 
15 uses these response vectors for further processing. This further processing 

may include forming new feature vectors for higher level processing or 
converting response vectors to scalars for controlling the real wdrd system 
represented by the image. Finally the method gets the next image and repeats 
the process. 

It will be understood by those skilled in the art that various modifications and 
changes may be made to the present invention without departure from the 
scope thereof, which is defined by the appended claims. 



20 
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1. An artificial vision method, characterized by: 

generating an image percept vector; 
• 5 transforming said image percept vector into a feature vector; and 

generating a response array by multiplying said feature vector by a 
trained linkage matrix modeling a percept-response system. 

2, The method of claim 1, characterized by said feature vector including the 
1 0 covariance products of said image percept vector. 

^ 3. The method of claim 2, characterized by said feature vector including the 

auto-covariance products of said image percept vector. 

15 4. The method of claim 3, characterized by said feature vector including 

components of said image percept vector. 

5, The method of any of the preceding claims, characterized in that the 
elements of said linkage matrix are non-negative. 

20 

6. The method of claim 5, characterized in that the elements of said linkage 
^ matrix are restricted to values between zero and a predetermined positive 

value. 

25 7. The method of any of the preceding claims, characterized by forming a 

coupled feature vector by coupling said feature vector to a response array, 
represented by a vector, using a Kronecker product before performing said 
matrix multiplication- 

30 8. The method of any of the preceding claims, characterized by forming a 

coupled feature vector by coupling said feature vector to several response 
arrays, represented by vectors, using repeated Kronecker products before 
performing said matrix mxiltiplication. 



99 03/26 16:0S FAX -i-46 18 153050 



AROS PyAfENT AB 



+46 18 153050 



28 



PATENTV-ERKET © 0 2 9 

6nk. t Patent- och reg.verket 
1999 -03- 2 6 

Nuvudfiaxen Kosson 



9. The method of any of the preceding claims 1-6, characterized by said 
response array being a coupled response vector formed by two response 
vectors coupled to each other by a Kronecker product. 

5 

10. The method of any of the preceding claims 1-6, chaxacteriased by said 
response array being a coupled response matrix formed by two response 
vectors coupled to each other by an outer product. 

10 11. The method of any of the preceding claims 1-6. characterized by said 

^ linkage matrix being a coupled linkage matrix formed by weighting a set of 

uncoupled linkage matrices with the elements of another response vector. 

12. The method of any of the preceding claims, characterized by converting 
15 each response vector into a corresponding scalar response signal. 

13. The method of any of the preceding claims, characterized by discarding 
linkage matrix elements below a predefined threshold. 

14. The method of any of the preceding claims, characterized by said percept 
vector being sparse, each non-zero percept vector element giving a continuous 
representation limited in definition range with respect to some variable 
property of an object in an image. 

15. The method of any of the preceding claims, characterized by said percept 
vector being sparse, each non-zero percept vector element giving a continuous 
representation, limited in spatial range, of the position an object in an image. 

16. An artificial vision system, characterized by; 

30 means (12, 14) for generating an image percept vector; 

means (16) for transforming said image percept vector into a feature 
vector; and 



20 



25 
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means (16) for generating a response array by miiltiplymg said feature 
vector by a trained linkage matrix modeling a percept-response system, 

17. The system of claim 16, characterized by means (18, 20) for training said 
linkage matrix. 

18. A percept-response system for sensing and control, characterized by: 

means (12, 14) for generating a percept vector; 

means (16) for transforming said percept vector into a feature vector; 

and 

means (16) for generating a response array by multiplying said feature 
vector by a trained linkage matrix modeling said percept-response system, 



19. The system of claim 18, characteriaed by means (18, 20) for training said 
linkage matrix. 
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An artificial vision system includes means (12, 14) for generating an image 
percept vector, means (16) for transforming this image percept vector into a 
5 feature vector, and means (16) for generating a response vector by multiplying 

the feature vector by a corresponding trained linkage matrix modeling a 
percept-response system. 

(Fig. 14) 
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